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Computer graphics processor and method of rendering images 



The invention relates to a computer graphics processor and a method of rendering images. 

BACKGROUND OF THE INVENTION 

In the area of computer graphics and video processing, there is a constant 
5 effort to improve the rendering capabilities of such systems to achieve more realistic images 
with less computational effort. 

Traditionally, texture mapping onto projections of 3D surfaces have been 
performed by inverse mapping from an area of the pixel onto surface texture. An alternative 
approach is shown in "3-d transformations of images in scanline order" by Edwin Catmull 
10 and Alvy Ray Smith, In Computer Graphics (SIGGRAPH '80 Proceedings), volume 14(3), 
pages 279 - 285, 1980. The texture surface is transformed as a 2D image until it conforms to 
a projection of a polygon placed arbitrarily in 3D space. This 2D transformation or mapping 
can be decomposed into a sequence of two orthogonal ID transformations, namely in a 
horizontal and in a vertical scanline order. In other words, multi-dimensional image 
15 transformations of resampling operations can be executed as a sequence of one dimensional 
transformation. 

However, one problem, that may arise within such a sequence of ID 
transformations, is the occurrence of aliasing due to shear. The shear problem is illustrated in 
Fig. 1 showing two lines of a texture map (left side of Fig. 1) and an intermediate image 

20 (right side of Fig. 1). The texture map has a black vertical line (at u=l), and the shear due to 
the perspective mapping is uttered such that the black pixel in the second line is shifted five 
pixels more to the right (x=6) than the black pixel on the first line (x=l). In order to prevent 
such horizontal aliasing, a horizontal filter pass is performed, which however can not prevent 
vertical aliasing. The shear causes a very sharp transition between black pixels in one line, 

25 and white pixels in the next. Also, the line in the intermediate image consists of disjunctive 
parts, separated by columns to which the line does not contribute (e.g. for x = 3). 

One solution to the shear problem is the so-called super-sampling technique 
proposed by George Wolberg and Terrance E. Boult in "Separable image warping with 
spatial lookup tables", in Computer Graphics (Proc. Siggraph '89), volume 23(3), pages 369 
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- 378, July 1989. Accordingly, the problem of aliasing occurs due to an under-sampling, so 
that a suggested solution is to increase the resolution by sampling the mapping function more 
densely. Therefore, the rasterisation is performed at a finer resolution (i.e. it is super- 
sampled), causing extra intermediate lines to be generated, with a black pixel at intermediate 
5 positions filling the holes. If this is done for shear introduced by a first pass, the second pass 
will down-scale the larger intermediate image to its final resolution. If shear in the second 
pass would be treated using the same supersampling approach, a third pass would be needed 
to reduce the generated higher horizontal resolution to the output resolution. Accordingly, the 
super-sampling technique is a compute intensive approach. 

10 Another approach to overcome the aliasing problem is based on a box filtering 

technique as described by A Ivy Ray Smith, in "Planar 2-pass texture mapping and warping", 
in Computer Graphics (Proceedings Siggraph 1987), volume 21(4), pages 263 - 272, 1987. 
Here, prefiltering is applied and constitutes a process of checking whether a pixel is inside 
e.g. a triangle (for the case of inverse mapping). The prefilter may have a delta function, a 

15 box function or the like. Without prefiltering each texel in the input texture is either mapped 
to screen space or not depending whether its position lies within the triangle. A prefilter is 
used to determine which texels should contribute to a subsequent resampling, i.e. also 
possibly those not totally inside the triangle, in order to reduce edge aliasing. An amount of 
overlap is determined between the triangle and a footprint of the prefilter, wherein the 

20 footprint of a prefilter corresponds to the area of the prefilter in the u/v directions in texture 
space. 

Fig. 2 shows an illustration of an output pixel footprint mapped to the input 
image. The left side of Fig. 2 shows a texture map 76, i.e. texels, in texture space, while the 
right side of Fig. 2 shows an intermediate image after horizontal transformation 77, i.e. 

25 pixels. The texture comprises a vertical column of grey texels 74. In the texture space, the 
square 72 depicts a box reconstructed footprint of a texel, ML the midline, 75 white texels 
and 73 a mapped box reconstructed prefilter footprint of a pixel. A box prefilter footprint of a 
pixel on a scanline 78 is shown in screen space. Accordingly, the footprint 78 of a box 
prefilter of the pixel on a scanline, indicated by the midline ML, is mapped to the texture 

30 space 76 and constitutes the mapped box reconstruction prefilter footprint. 

In Fig. 2 a horizontal span of output pixels are modeled as a row of 
neighboring squares representing footprints of a box prefilter. The footprint 73 of these pixels 
mapped to the scanline of the input image constitutes an area limited above and below by 
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parallel line segments and left and right by curves and in particular straight lines for some 
transformations as shown in Fig. 2. 

The pixel color being box filtered is composed of the average of the texel 
colors whose footprints of the box reconstruction filter intersects the mapped footprint 73 of 
5 the pixel. A weighting function is performed on the texels in accordance of the size of the 

footprint area of the reconstruction filter 72 intersecting with the pixel's mapped footprint 73, 
i.e. in accordance with the area overlap of the footprint area of the reconstruction filter and 
the footprint of the mapped pixel. Although, a more accurate average can thus be achieved 
than a strictly ID average over the midline ML of these areas (selecting only the dark texel to 
10 contribute in Fig. 2), 2D computations (i.e. area overlap calculation) are required within the 
ID scanline computations, resulting in a compute intensive technique. 

SUMMARY OF THE INVENTION 

It is therefore an object of the invention to provide a computer graphics 
1 5 processor and a method of rendering images which are capable of further reducing aliasing 
due to shear with moderate computing requirements. 

This object is solved by a computer graphics processor according to claim 1 
and a method of rendering according to claim 8. 

Therefore, a computer graphics processor with a forward mapping renderer is 
20 provided. The renderer comprises a texture space rasterizer TS for rasterizing a primitive in 
texture space, a color generating unit PS for determining the color of the output of the texture 
space rasterizer TS and for forwarding a color sample along with coordinates, a 2-pass screen 
space resampler SSR1, SSR2 for resampling the color sample determined by the color 
generating unit PS, and at least one one-dimensional blur filter unit 1PB, 2PB associated to at 
25 least one pass of said screen space resampler SSR1, SSR2 for performing a ID filtering 
before performing at least one pass. 

Therefore, only ID calculations need to be performed during the resampling 
operation. In order to avoid the gaps shown in Figure 1, whose lines, that are perpendicular to 
the shear direction, are smeared over more pixels. This can be achieved by a blur filter which 
30 provides a good approximation of the necessary 2D filtering. 

According to an aspect of the invention, said processor comprises a first and 
second one-dimensional blur filter unit. Said screen space resampler comprises a first pass 
and a second pass screen space resampler. Said first blur filter unit is arranged before said 
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first pass screen space resampler and said second blur filter unit is arranged before a second 
pass screen space resampler. Accordingly, the blur may be applied to both passes. 

According to a preferred aspect of the invention said first and second blur 
filter units are one-dimensional blur filters having footprints with a size depending on a 
5 corresponding shear factor, so that more blur may be introduced when there is more shear. 
Thus aliasing due to shear is effectively prevented. 

According to a further aspect of the invention, said first and second blur filter 
units are box low pass filter having a weighted footprint. With such a footprint the 
contribution of a 2D footprint may be approximated more efficiently. 
10 The invention also relates to a method of rendering images based on a forward 

mapping rendering. A primitive is rasterized in texture space. The color of the output of the 
rasterizing step is determined and a color sample is forwarded along with coordinates. A 2- 
pass screen space resampling of the color sample determined in the color generating step is 
performed. At least one one-dimensional blur filtering is performed before performing at 
1 5 least one pass resampling. 

The invention furthermore relates to a computer program product comprising 
program code means stored on a computer readable medium for performing an above method 
when said program is run on a computer 

Further aspects of the invention are defined in the dependent claims. 
20 The invention is based on the idea to avoid the computation of an area overlap 

of the texel's footprint with the mapped footprint of a pixel, i.e. a 2D computation. Instead 
only 1 D computations are used by applying a ID filter to the texel. 

BRIEF DESCRIPTION OF THE DRAWINGS 
25 In the drawings: 

Fig. 1 shows an illustration of aliasing due to shear caused by texture mapping, 
Fig. 2 shows an illustration of an output pixel footprint mapped to an input 

image, 

Fig. 3 shows a forward mapping pipeline according to a first embodiment of 

30 the invention, 

Fig. 4 shows a detailed illustration of the right hand side of Fig. 2 with a 1 D 

filtering, 

Fig. 5 shows an illustration of an improved ID filtering to approximate a 2D 

filter footprint, 
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Fig. 6 shows an illustration of a shrunk footprint of Fig. 5, and 
Fig. 7 shows an illustration of a weighting of the footprint of Fig. 6 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
5 Fig. 3 shows a forward mapping pipeline according to a first embodiment of 

the invention. This forward mapping pipeline comprises a texture space rasterizer TS, a 
texture memory TM, a texture space resampler TSR, a pixel shader PS, a first pass and a 
second pass blur unit 1PB, 2PB, a first pass and a second pass screen space resampler SSR1, 
SSR2, and a pixel fragment combiner PFC. 

10 First of all, the basic operation of the forward rendering pipeline is described. 

The rasterization is performed in texture space and the texture space rasteriser TS traverses a 
projection of a primitive onto a texture map by selecting texture coordinates as variables for 
the rasterization process. The texture space rasterizer TS may transverse the texture map on a 
texture grid. Texels being confined with the primitive or polygon being rasterized are to be 

1 5 splat on pixels in screen space. 

Therefore, the pixel shader PS and the texture space resampler TSR (of which 
there may be one or more, for serial or parallel fetching of texture samples, if several textures 
are present) correspond to those in a traditional pipeline. The pixel shader PS receives a set of 
(interpolated) attributes, including texture and screen coordinates, for one location. The 

20 texture coordinates, along with the shading program, determine where to index the texture 
maps via the texture space resampler TSR. The shader can also modify texture coordinates 
before sending them to the texture space resampler TSR to implement dependent texturing, as 
in the same way as in a traditional pipeline. 

The shader PS passes the shaded color on to the screen space resampler SSR, 

25 along with the associated screen coordinates. These in general are not integer, but this is 
similar to how a pixel shader in a traditional pixel shader pipeline might receive sub-pixel 
screen positions when performing super-sampling. The screen space resampler SSR splats the 
mapped texels to integer screen positions, so that an image of the primitive is provided on the 
screen. The pixel fragments from the screen space resampler SSR may be combined in the 

30 pixel fragment combiner PFC. 

The shaded color sample resulting from the pixel shading process is forwarded 
to the screen space resampler SSR along with its screen coordinates. The screen space 
resampler SSR resamples these color samples, (located generally at non-integer pixel 
positions) to the integer pixel positions needed for display. 
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The screen space resampling is now described in more detail. The approach to 
reduce the aliasing due to shear in the screen space resampling is based on an approximation 
of the box filtering technique and is directed to avoiding the computation of the area overlap 
of the (box reconstructed) footprint of a texel with the mapped footprint of a pixel. This 
5 process is approximated using only 1 D computations over the midline: a 1 D blur (low pass) 
filter is applied to the texels with the filter footprint size depending on the local shear factor 
(resulting in more blur with more shear). The shear factor may be received from the texture 
space rasterizer TS. The blur may be applied both in the first (e.g. horizontal) pass and in the 
second (e.g. vertical) pass. 

10 Fig. 4 shows a detailed view of the right side of Figure 2 but with the footprint 

of the box reconstructed texels mapped in output space. If merely the texePs ID footprint on 
the midline ML (indicated with the double sided arrow) would be mapped to the output 
space, a discontinuous diagonal line would be obtained, only represented with the indicated 
dark grey separate square areas. If the transformation with shear is applied on the 2D 

15 reconstruction footprint of the texels of the vertical line, a continuous parallelogram 20 
consisting of the mapped footprints of these texels is obtained that represents the mapped 
line. The shear due to the 1 * pass is indicated by the distance 23. To determine the horizontal 
shear factor of a given texel, the rasteriser can determine the location in the screen of half a 
pixel spacing above (this location was computed when rasterizing the previous line) and half 

20 a pixel spacing below the midline. The horizontal distance 23 of the two screen locations 
corresponds to the horizontal shear factor. The vertical shear factor can be determined by 
looking at the vertical distance of the screen locations corresponding to two locations that are 
half a pixel spacing to the left and half a pixel spacing to the right of the midline. The 
distance 22 represents the gap between non adjacent mapped filter footprints if the mapping 

25 would only be based on the ID filter footprint on the midline. 

Fig. 5 shows a representation of an improved texel filter footprint. Here, the 
concept of "stretched texels" is implemented and constitutes an improved approximation of 
the mapped sheared 2D footprint of the texel using ID filtering. The ID footprint of the 
texels over the midline ML are stretched according to the local shear factor. In particular, 

30 four 1 D footprints on the midline A, B, C, D of four texels are shown in Fig. 5. The 1 D 
footprints are stretched resulting in four stretched texels 30. The stretched texels have the 
same length as the local shear factor. Additionally, an averaging of the overlapping stretched 
texels may be performed to deliver the desired anti-aliased and blurred texels 31 that are 
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forwarded to the screen space resampler. Accordingly, the averages 3 1 of the overlapping 
parts and hence the blurred texels 31 result in (A+B+C)/3, (B+C+D)/3, and (A+B+C+D)/4. 

However, the averaging of n stretched texels requires a delay unit which is 
able to contain n stretched texels. A maximum of n may be 8, so that, a maximum of 8 delay 
5 elements is used. In such a case the stretched texels may be limited to a width of 8 texel 
spacings. However, alternative widths of the stretched texels are also possible. 

Fig. 6 depicts that the footprints of Fig. 5 are shrunk. Here, a box low pass 
reconstruction filter for the stretched texels, i.e. an uniform distributing along the footprint, is 
used. The footprint of the box stretched texel is not fitted to the 2D borders 41 of the 

10 footprint directly but the footprint 40 is shrunk half a mapped texel spacing on both sides, i.e. 
the resulting ID footprint extends between the sheared midpoints MP of the footprint. 
Accordingly, areas a are excluded for contribution, but these are equal to areas b which are 
included for contribution. The ID footprint 42 over the midline ML is stretched to the ID 
footprint 41 according to the local shear factor and the final ID footprint 40 is shrunk to 

1 5 extend between the midpoints of the 2D footprint. 

Fig. 7 shows an illustration of an alternative filter for the 2D footprint. The 
stretched texel 50 is weighted with a linear weighting at its ends. With such a weighted filter 
a better approximation of the contribution of the 2D footprint along the ID footprint of the 
stretched texel is achieved. 

20 Alternatively to the above box reconstruction filter, principle of shear anti- 

aliasing may also be used for wider (higher order) reconstruction filters. However, the 
averaging of the stretched texels (now weighted along their footprint with the higher order 
filter) will become more difficult. 

It should be noted that the above-mentioned embodiments illustrate rather than 

25 limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. The 
word "comprising" does not exclude the presence of elements or steps other than those listed 
in a claim. The word "a" or "an" preceding an element does not exclude the presence of a 

30 plurality of such elements. In the device claim enumerating several means, several of these 
means can be embodied by one and the same item of hardware. The mere fact that certain 
measures are recited in mutually different dependent claims does not indicate that a 
combination of these measures cannot be used to advantage. 
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Furthermore, any reference signs in the claims shall not be construed as 
limiting the scope of the claims. 



